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Abstract 

In this paper, we show the effects on the transition probabilities for neutrino oscillations due to a thin constant 
density layer perturbation added to an arbitrary matter density profile. In the case of two neutrino flavors, we 
calculate the effects both analytically and numerically, whereas in the case of three neutrino flavors, we perform 
the studies purely numerically. As an realistic example we consider the effects of the Earth's atmosphere when 
added to the Earth's matter density profile on the neutrino oscillation transition probabilities for atmospheric 
neutrinos. 
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1. Introduction 

The measurements in neutrino oscillation ex- 
periments are becoming more and more accurate 
{e.g. the Super-Kamiokande and SNO experi- 
ments |Q,0]). This means that we have to use 
three neutrino flavors in the analyses of data. 
The measurement of atmospheric neutrinos con- 
tains also another important issue. How large 
are the effects on the neutrino oscillation proba- 
bilities due to the Earth's atmosphere? In order 
to answer this question, we will in this paper in 
general consider the effects of a thin density layer 
perturbation on an arbitrary matter density pro- 
file. 

This paper is organized as follows: In Sec. |[ we 
derive the formalism. In Sec. |[ the special cases 
of two and three neutrino flavors are investigated 
as well as the analysis of atmospheric neutrinos. 
Finally, in Sec. |[ we present a summary as well 
as our conclusions. 

2. Formalism 

Neutrino propagation in matter of constant 
density can be described by an evolution oper- 
ator 

U f {L;A) = e- l ^ {A)L , (1) 



where Jfff(A) = \JH m \J- x + A diag (1,0,..., 0) 
is the total Hamiltonian in the flavor basis, L 
is the neutrino (traveling) path length, i.e., the 
baseline length, and A is the (constant) matter 
density parameter related to the (constant) mat- 
ter density p as A = \[2Gf-^P- Here H m = 
diag (Ei,E 2 , ... , E n ), where E a = m 2 J(2E v ), is 
the free Hamiltonian in the mass basis, U — (U aa ) 
is the leptonic mixing matrix, Gf — 1.16639 • 
10 -23 eV -2 is the Fermi weak coupling constant, 
Y e is the average number of electrons per nu- 
cleon[], and tun — 939 MeV is the nucleon mass. 
Furthermore, n is the number of neutrino flavors, 
m a is the mass of the ath mass eigenstate, and 
E v is the neutrino energy. 

Using the evolution operator method developed 
in Ref. || , the total evolution operator in matter 
consisting of N different (constant) matter den- 
sity layers is given by 

JY 

U f (L) = l[u f (L k ;A k ), (2) 

fc=i 

where L k and A k is the thickness and matter den- 
sity parameter of the fcth matter density layer, re- 
spectively, and L = ^ZfeLi ^k- Similar methods to 
the evolution operator method for propagation of 
neutrinos in matter consisting of two density lay- 
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Figure 1. The (constant) matter density profile 
with the thin (constant) density layer perturba- 
tion. The densities pa and p a correspond to the 
matter density parameters A and a, respectively. 
Note that p a can in general be both smaller and 
larger than pa- 



ers using two neutrino flavors have been discussed 
in Refs. @§. 

In order to investigate the effects of a thin den- 
sity layer perturbation on a constant matter den- 
sity profile, we can thus use this method and we 
obtain the total evolution operator as 



U f (L') = U f (l;a)U f (L;A), 



(3) 



where V = L + I. Here I and a are the path 
length and matter density parameter of the den- 
sity perturbation, respectively. See Fig. [j] for the 
geometry. Without loss of generality, we can in 
fact set a = and we will write Eq. (0) as f| 



U f (L') = U f (l)U f (L;A). 



(4) 



Note that it is the density difference Ap = pa — Pa 
that is important, i.e., the absolute density scale 
is not crucial, which means that one can choose 
a = 0. 

The neutrino oscillation transition amplitude 
from a neutrino flavor v a to a neutrino flavor up 
is defined as 



A al3 = (vp\Uf\v a ), a,P = e,p,r,. 



(5) 



Therefore, the corresponding neutrino oscillation 
transition probability for v a <-*■ up is given by 

P a p = \A a/ 3\ 2 , a,fl = e,p,,T, ... . (6) 

Inserting Eq. (B) into Eq. (||) and the result 
thereof into Eq. (|6|), we find 



P af3 (LJ;A) = \{y \U f {l)U f {L-A)\ Va )\\ 



(7) 



which can be re-written as 



P a0 (L,l;A) = J2("fi\Uf(l)Wy)(^\Uf(L;A)\v a ) 

7 

(8) 

Expanding this equation gives 

P a/3 {L,l;A) = ^P ai {L;A)P 1 f } {l) 

7 

+ E E A «7^; A)A* lP {l)A aS {L ] A)A 5f3 (l). 

7 5 
7#<5 

(9) 

Note that the summation indices in the sums run 
over all n flavor states. 

As measures of the effects of the thin density 
layer perturbation, we will define the following 
difference 

AP a p = P a p{L,l-A)~P aP {L-A), (10) 

which corresponds to the absolute error of the 
neutrino oscillation transition probability P a /3, as 
well as the two relative errors 
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aP ~ P a p{L;A) m 
Note that it holds that e a p w e' a g. 
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3. Two and three neutrino flavors 

In this section, we will discuss the particular 
cases of two and three neutrino flavors. 

For two neutrino flavors we have for the thin 
constant density layer perturbation |Q 



4 ^ y^PctaUpgUgbUpb SU1 2 X abl 



a=l 6=1 
a<b 



A a ^(l) = ^ U aa Uf3a( 



—iE„l 



(13) 
(14) 



a=l 



where 



x a b = (- E ° Eb ^ 1 and the leptonic mixing 
matrix elements are given in terms of the vacuum 
mixing angle 9 as U e \ — = cos 9 and U e2 = 
—U^i = sin9. Inserting Eqs. ( |l3| ) and (Oj) into 
Eq. (|j) and the result thereof into Eq. (|To|) , we 
obtain (for a = e and /3 = (J,) after some tedious 
calculations 

AP efl {L, I; A) = sin 2 29 [1 - 2P eil {L; A)} 
x sin 2 X21 + sin 29 3?{^4* e (L; A)A e ^(L; A) 
x [cos 29- (e~ 2lX21 cos 2 9 - e 2 " 21 sin 2 6)]}, 

(15) 

where denotes the real part of the complex 
number z. Furthermore, we have for the constant 
matter density profile (matter density parameter 
A * 0) § 
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sin 2 26» 
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and is a phase factor. (Q| A=0 = = ^) 
Using these relations, we finally obtain 
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(20) 



So far we have carried out all calculations ex- 
actly. Note that for A = we have P eM (L, I; 0) = 
sin 2 26 , (sin 2 x 2 i + sin 2 X21 + \ sin 2x 2 i sin 2X 2 i - 
2sin 2 X21 sin 2 X 2 i) = sin 2 29 sin 2 (x 2 i + X 2 i) = 
P e ^(L + I; 0), since AP ef ,(L, I; 0) = P efl (L, I; 0) - 
P ef >(L; 0) and P efi (L; 0) = sin 2 2(9 sin 2 X 2 i- 

Let us now assume that I <C L, which also im- 
plies that X21 <C X21. This means that we can 
series expand Eqs. (|l9| ) and ( p(i| ) in the small di- 
mensionless parameter X21 = X2\-j j - Carrying 
out the series expansions, we obtain to first order 



AP efl (L,l;A) 



sin 2 29 sin 2VLL 
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and 



(L,l;A) 



2Q.L cot QL-. 

L 



(22) 



As a realistic example, let us now discuss 
the influence of the Earth's atmosphere on the 
transition probabilities for atmospheric neutrinos 
traversing the Earth. The atmosphere will in this 
case serve as the thin constant density layer per- 
turbation. To a very good approximation the 
density of the atmosphere can be assumed to be 
equal to zero (p a = 0). Note that atmospheric 
neutrinos first traverse the atmosphere and then 
the Earth's matter density profile, i.e., they first 
traverse the thin constant density layer perturba- 
tion and then the matter density profile, which 
is the reverse total matter density profile to the 
one shown in Fig. [j] In the case of two neu- 
trino flavors, the direct and reverse total mat- 
ter density profiles will give the same results, 
since there are no T- violating effects in this case 

(P efl = AP£ = P eM - P Me = 0). 

However, in the case of three neutrino flavors, the 
order of the thin constant density layer perturba- 
tion and the matter density profile plays a role 
and will cause a non-zero matter-induced T vio- 
lation [^U|]. The traveling path lengths of atmo- 
spheric neutrinos in the Earth's matter density 
profile and the Earth's atmosphere can be found 
from simple geometrical considerations and are 
given by 



L = L§(h) = 2R^cosh, 
l = L atm .(h) = -R B cosh 



(23) 



(i? e + df - R% sin 2 h, 



(24) 

respectively, where ~ 6371 km is the equato- 
rial radius of the Earth, d = (10—20) km ~ 15 km 
is the thickness of the Earth's atmosphere, and 
< h < 90° is the nadir angle. 

The ratio of traveling path lengths in the at- 
mosphere and in the Earth, 



/ 

L 




1 



tan 2 h) 



tan 2 h — 1 



is plotted as a function of the nadir angle h in 
Fig. [| Since we are interested in the traveling 



Figure 2. The ratio between the distances trav- 
eled by neutrinos in the Earth's atmosphere and 
the Earth's matter density profile l/L as a func- 
tion of the nadir angle h. The solid curve is plot- 
ted for d — 15 km, whereas the two dashed-dotted 
curves are plotted for d — 10 km and d = 20 km, 
respectively. 



paths of atmospheric neutrinos that are only a 
small fraction in the atmosphere, we will restrict 
ourselves to the cases when l/L < 0.10, which 
corresponds to a nadir angle 



arctan , 



(1 



(l + 7^) 2 



< 84°. 



In the limit h — > 90°, the neutrinos travel the 
"maximal" distance in the atmosphere and just 
touch the surface of the Earth. 

For two neutrino flavors we have the effec- 
tive (vacuum) mixing parameters ~ #13 ~ 5°, 
which is below the CHOOZ upper bound^| and 
Am 2 ~ Am| 2 ~ 2.5 • 10" 3 eV 2 0, which is the 
latest best fit value of the Super-Kamiokande col- 
laboration. Furthermore, we assume completely 
Earth-through-going atmospheric neutrinos (h = 
0) with neutrino energy E v = 1 GeV, which is a 
reasonable value of the neutrino energy for atmo- 
spheric neutrinos. 

2 The CHOOZ upper bound is: sin 2 26»i 3 < 0.10 00 
0i3 < 9.2°. 
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Figure 3. The relative error e' as a function of 
the ratio l/L for atmospheric neutrinos, differ- 
ent numbers of neutrino flavors, as well as dif- 
ferent models of the matter density profile. For 
all curves we have used E v = 1 GeV (reasonable 
for atmospheric neutrinos) and h — (completely 
Earth-through-going neutrinos). The dotted line: 
Eq. (E2r| with pa — 7.8 g/cm 3 ; the dashed curve: 
Eq. ( j20| ) with pa — 7.8 g/cm 3 ; the thin solid 
curve: the Earth matter density profile with two 
neutrino flavors; the thick solid curve: the Earth 
matter density profile with three neutrino flavors. 
The two vertical dashed-dotted lines mark the in- 
terval relevant for the Earth's atmosphere. The 
differences of the slopes of the curves close to 
l/L = are due to different models of the matter 
density profile. 



In Fig. [| we show the relative error e' of the 
transition probability for v e <-> that one makes 
omitting the Earth's atmosphere in the calcula- 
tion of the transition probability P eLl . The dotted 
line is a plot of Eq . (^2|) , whereas the dashed curve 
is a plot of Eq. (|20|). Both these plots assume 
a value of the matter density parameter A that 
corresponds to the average value of the density of 
the Earth, i.e., pa — 7.8 g/cm 3 . We note that 
Eq. ( p2|) is a good approximation to Eq. (^Tj) for 
the values of l/L that are relevant for the Earth's 
atmosphere. The thin and thick solid curves use 
the usual mantle-core-mantle step function ap- 



proximation for the Earth matter density profile.^ 
The thin solid curve is a plot using two neutrino 
flavors, whereas the thick solid curve is a plot us- 
ing three neutrino flavors. We observe that the 
absolute value of the relative error e' of the tran- 
sition probability P eLl is of the order of 15% - 25% 
depending on the value of the thickness of the at- 
mosphere. This is a large error and shows that the 
atmosphere cannot be neglected in trustablc anal- 
yses. Increasing the value of the vacuum mixing 
angle 9 from 5° to 10°, the relative error becomes 
even larger e' ~ 50%. In order to separate the 
thickness effects of the thin density layer pertur- 
bation from the matter effects, we determine the 
relative error ^ for A = 0, i.e., the relative error 
induced by the difference in the baseline lengths, 
to be 

e' (L, l;0)= , 2 — + sin 2x 2 i cot X 2 i 
sin X 2 i 

-2 sin 2 x 2 i ^ 0.0304 w 3% (25) 

with L = 12742 km and I = 15 km. Thus, 
the thickness effects are small compared with the 
matter effects. Note that the above formula is 
independent of the vacuum mixing angle 9. 

So far the present analysis for two neutrino fla- 
vors has been conducted on the level of transi- 
tion probabilities using a monochromatic value 
of the neutrino energy E u . In practice, however, 
the energy resolution of an experiment must be 
taken into account including energy uncertainties 
(or even better the analysis should be performed 
on the level of neutrino event rates), since neutri- 
nos are neither produced nor detected with sharp 
energy. Another problem is attached to the defi- 
nitions of the relative errors in Eqs. ( p0| ) and (p2|). 
In the case when P e/Jj (L,l; A) and/or P e)Ji (L;A) 
become zero, the corresponding relative errors e e/i 
and e' go to infinity. Also when P efl {L,l;A) 
and P efJ ,(L;A) are small, we will obtain large er- 
rors. This problem can be overcome by averaging 

3 The mantle-core-mantle step function approximation of 
the Earth matter density profile consists of three con- 
stant matter density layers (mantle, core, and mantle) 
with p man tio = 4.5 g/cm 3 and p coro = 11.5 g/cm 3 . It 
has been shown that the mantle-core-mantle step func- 
tion model is a very good approximation to the (realistic) 
Earth matter density profile p3[. 
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over the neutrino energy, which will smoothen the 
transition probabilities and therefore lead to less 
varying errors. Thus, let us next estimate the rel- 
ative error d when the resolution of the neutrino 
energy has been included. We assume for simplic- 
ity that the neutrinos are Gaussian distributed in 
energy with an average neutrino energy E u and 
a corresponding uncertainty AE V . The Gaussian 
average is defined by 



e ' AE U V^ 

e' efi (E v )e ^^WdE u . (26) 

-OC 

The energy resolution of the Super-Kamiokande 
experiment is of the order of magnitude AE V ~ 
E v . Using this energy resolution and an average 
neutrino energy E v — 1 GeV, we can, for exam- 
ple, compute the Gaussian averaged relative error 
(e' ) for the case given in Eq. (p5|), and we ob- 
tain (e^(L,Z;0)) ~ 0.0181 w 2%. Indeed, the 
Gaussian averaged relative error is smaller than 
the non-averaged one. 

For three neutrino flavors the most probable 
vacuum mixing parameters are 9\2 — 45°, $13 ~ 
5°, 6*23 ^ 45°, S C p = 0, Amli ~ 3.65 • 10~ 5 eV 2 , 
and Am 2 2 ~ 2.5- 10 -3 eV 2 . The values of the pa- 
rameters #12 and Arn 2 .! correspond to the best fit 
point values of the large mixing angle (LMA) so- 
lution jl3| , whereas the values of the parameters 
6*23 and Am| 2 correspond to the latest best fit val- 
ues from the Super-Kamiokande collaboration Q . 
Using these values of the mixing parameters, we 
have in Figs. [| - [j] plotted as density plots the 
absolute errors of the transition probabilities for 
v e *-> v in v e *-* Vti an d Vfi <-> v r . These density 
plots also use the mantle-core-mantle step func- 
tion approximation for the Earth's matter density 
profile. We observe that the errors are largest 
for P^ T and smallest for P efl . Actually, for P„ r 
the error can be close to 100% depending on the 
nadir angle and the neutrino energy. The errors 
decrease for increasing neutrino energy and natu- 
rally they increase for increasing nadir angle. Fur- 
thermore, note that the errors are due to both the 
difference in lengths of the baselines (L' = L + I 
for the case with the Earth's matter density pro- 
file included; L for the case without) as well as 



the difference in density Ap = pA, i.e., the errors 
are thickness and matter effects arising from the 
thin density layer perturbation. 

4. Summary and conclusions 

In summary, we have derived analytically exact 
as well as approximate formulas for the absolute 
and relative errors of the transition probabilities 
for neutrino oscillations using a thin density layer 
perturbation in the case of two neutrino flavors. 
It should be noted that for three neutrino flavors 
this is not easily achieved. However, for three 
neutrino flavors we have studied the influence of a 
thin density layer perturbation numerically. The 
studies were carried out for one of the most in- 
teresting experimental setups, i.e., atmospheric 
neutrinos. We assumed the Earth's matter den- 
sity profile with the Earth's atmosphere as the 
thin density layer perturbation. 

In conclusion, we found that the transition 
probabilities are rather influenced by a thin den- 
sity layer perturbation, even though its length is 
at least one order of magnitude smaller than that 
of the matter density profile. In the case of at- 
mospheric neutrinos, using three neutrino flavors, 
the absolute error AP MT of the transition proba- 
bility P^ T could nearly be as large as 100% for 
certain realistic nadir angles and neutrino ener- 
gies. This is despite the fact that the distance 
traveled by neutrinos in the Earth's atmosphere 
is much shorter than the distance that they travel 
in the Earth's matter density profile; at least for 
nadir angles h < 84°. Thus, it is important also 
to include the Earth's atmosphere in the analy- 
ses of atmospheric neutrinos. Note that we are 
fully aware of that in most such analyses this is 
certainly done. Furthermore, taking energy reso- 
lution into account will definitely reduce the er- 
rors of the transition probabilities. The purpose 
of this work was to investigate and determine the 
actual effects of the Earth's atmosphere being in 
principle just a thin density layer perturbation in 
comparison with the Earth's matter density pro- 
file itself. 

Finally, note that this paper is in principle the 
"counterpart" to the study performed in Rcf. Q , 
in which the distance traveled by neutrinos in 
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Figure 4. The difference AP e ^ as a function of the nadir angle h and the neutrino energy E v for three 
neutrino flavors assuming the Earth's matter density profile. 
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Figure 5. The difference AP eT as a function of the nadir angle h and the neutrino energy E v for three 
neutrino flavors assuming the Earth's matter density profile. 
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Figure 6. The difference AP^ T as a function of the nadir angle h and the neutrino energy E v for three 
neutrino flavors assuming the Earth's matter density profile. 



matter is assumed to be short compared with the 
distance in vacuum. 
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